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(54) Image input system 

(57) This invention provides an image input system 
capable of setting an arbitrary imaging inhibited area. 
This system displays a map showing the positions of 
cameras arranged in an office and the directions in 
which these cameras can be aimed, or displays the view 
angles of the cameras. An operator designates an 
imaging inhibited area on the map. In accordance with 
the designated imaging inhibited area, a limiting direc- 
tion is calculated for each camera, and each camera is 
so controlled as not to point in that direction. Even when 
cameras are fixed, the system controls display so that 
an imaging inhibited area is not displayed. 
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Description 

BACKGROUND OF THE INVENTION 

The present invention relates to a camera control s 
system and. more particularly, to a camera control sys- 
tem in which at least one operator remotely operates at 
least one camera. 

A video transmission system has been proposed in 
which large numbers of cameras and computers are 
arranged in a building and connected in a network to 
enable transmission of images or conversations using 
images and voices between two (or three or more) arbi- 
trary points. For example, this system is expected to be 
used as a video conference system or a remote moni- 
toring system. For these purposes, cameras whose 
direction and zooming can be externally controlled are 
already commercially available. In such a video trans- 
mission system each operator can remotely operate a 
given camera from a given place and/or display an 
image taken by a given camera on the screen of his or 
her computer. 

In a video transmission system in which remote 
control of a given camera is possible, as the number of 
cameras to be operated increases H is more and more 
necessary to allow each operator to readily know the 
location of each camera. The present applicant has 
already proposed a system in which camera symbols 
indicating individual cameras are superposed on a map 
image which shows the installation sites of these cam- 
eras. The present applicant has also proposed a system 
in which the direction of each camera is indicated by the 
direction of a corresponding camera symbol. 

The following problem arises when further improve- 
ments of a camera control system of this sort are 
attempted. That is. any user using the system can freely 
remotely operate cameras connected toother hosts and 
see images taken by these cameras. However, persons 
in the sensing enable ranges of the cameras to be 
remotely operated feel as if they were being monitored, 
and this may give them a strong unpleasant feeling. 
That is, under this condition the privacy of each person 
in the imaging range of a camera is invaded. 

SUMMARY QF THE INVENTION 

It is a concern of the present invention to solve the 
above conventional problem and provide a camera con- 
trol system in which the protection of privacy is taken 
into consideration. 

That is an embodiment of the present invention pro- 
vides a camera control system in which a range within 
which imaging is not permitted, i.e.. an imaging inhibited 
range, can be set for each camera, and an image in this 
imaging inhibited range cannot be physically or essen- 
tially taken by a remote operation. 

It is another concern of the present invention to pro- 
vide a camera control system in which each operator 
can easily recognize the imaging inhibited range of 



each camera which he or she intends to remotely oper- 
ate. 

ft is still another concern of the present invention to 
provide a camera control system which can rapidly set 
the imaging direction or the magnification of an image. 

In accordance with the invention a camera control 
system according to the present invention has the fol- 
lowing aspects. 

an image input system comprising: 
image pick-up means for pi cking-up an image in 
a predetermined area; 

setting means for setting an imaging inhibited 
area in which imaging is inhibited in the predetermined 
area; 

input means for inputting an image of a desired 
area excluding the imaging inhibited area set by the set- 
ting means from the predetermined area picked-up by 
the pick-up means; and 

display means for displaying the input image 
from the input means. 

An image input system for displaying an input 
image, comprising: 

at least one camera for picking-up an image of an 

object; 

camera moving means for moving the camera by 
one or both of panning and tilting; 

map display means for displaying a map showing 
a position of the camera and a direction in which the 
camera can be aimed by the camera moving means; 

setting means for setting an imaging inhibited 
area in which image-picking-up is inhibited on the map 
displayed by the map display means; and 

display means for displaying an image picked-up 
by a desired at least one of the at least one camera. 

An image input system for displaying an input 
image, comprising: 

at least one camera for picking-up an image of an 

object; 

camera moving means for moving the camera 
within a predetermined range by one or both of panning 
and tilting; 

direction designating means for designating a 
direction of a desired camera of the at least one cam- 
era; 

message display means for displaying a mes- 
sage indicating that the camera cannot be moved, when 
the direction designated by the direction designating 
means falls outside the predetermined range; and 

image display means for displaying an image 
picked-up by the desired camera. 

An image input system for displaying an input 
image, comprising: 

at least one camera for picking-up an image of an 

object; 

camera moving means for moving the camera 
within a predetermined range by one or both of panning 
and tilting; 

direction designating means for designating a 
direction of a desired camera of the at least one cam- 
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era; 

control means for aiming the camera at a posi- 
tion closest to the direction designated by the direction 
designating means, when the direction designated by 
the direction designating means falls outside the prede- 
termined range; and 

image display means for displaying an image 
picked-up by the desired camera. 

An image input system for displaying an input 
image, comprising: 

at least one camera for picking-up an image of an 

object; 

region designating means for designating a par- 
tial region having a desired size and a desired position 
from an input image picked up by a desired camera of 
the at least one camera; and 

display means for displaying the partial region 
designated by the region designating means. 

An image display method of displaying an image 
picked-up by image pick-up means* comprising: 

a setting step of setting an imaging inhbited area 
in which imaging is inhibited in a predetermined area; 

an input step of inputting an image of a desired 
area excluding the imaging inhibited area set by the set- 
ting step from the predetermined area picked-up by the 
pick-up means; and 

a display step of displaying the input image from 
the input step. 

An image display method of displaying an image 
picked-up by at least one camera moved by one or both 
of panning and tilting by camera moving means, com* 
prising: 

a map display step of displaying a map showing 
a position of the camera and a direction in which the 
camera can be aimed by the camera moving means; 

a setting step of setting an imaging inhbited area 
in which image picking-up is inhbited on the map dis- 
played by the map display step; and 

a display step of displaying an image picked-up 
by a desired one of the at least one camera 

An image display method of displaying an image 
picked-up by at least one camera moved within a prede- 
termined range by one or both of panning and tilting by 
camera moving means, comprising: 

a direction designating step of designating a 
direction of a desired camera of the at least one cam- 
era; 

a message display step of displaying a message 
indicating that the camera cannot be moved, when the 
direction designated by the direction designating step 
falls outside the predetermined range; and 

an image display step of displaying an image 
picked-up by the desired camera. 

An image display method of displaying an image 
picked-up by at least one camera moved within a prede- 
termined range by one or both of panning and tilting by 
camera moving means, comprising: 

a direction designating step of designating a 
direction of a desired camera of the at least one cam- 



era; 

a control step of aiming the camera at a position 
dosest to the direction designated by the direction des- 
ignating step, when the direction designated by the 
5 direction designating step falls outside the predeter- 
mined range; and 

an image display step of displaying an image 
taken by the desired camera. 

An image display method of displaying an image 
to picked-up by at least one camera, comprising: 

the region designating step of designating a par- 
tial region having a desired size and a desired position 
from an input image taken by a desired camera of the at 
least one camera; and 
is the display step of displaying the partial region 

designated by the region designating step. 

A computer readable memory storing a program of 
displaying an image taken by image pick-up means, 
comprising: 

20 codes of a process of setting an imaging inhib- 

ited area in which imaging is inhibited in a predeter- 
mined area; 

codes of a process of inputting an image of a 
desired area excluding the imaging inhibited area set by 
25 the setting step from the predetermined area; and 

codes of the display step of displaying the input 
image from the input step. 

A computer readable memory of the present inven- 
tion has the following arrangements. 
30 A computer readable memory storing a program of 
displaying an image taken by at least one camera 
moved by one or both of panning and tilting by camera 
moving means, comprising: 

codes of a process of displaying a map showing 
35 a position of the camera and a direction in which the 
camera can be aimed by the camera moving means; 

codes of a process of setting an imaging inhib- 
ited area in which imaging is inhibited on the map dis- 
played by the map display step; and 
40 codes of a process of displaying an image taken 

by a desired one of the at least one camera. 

A computer readable memory storing a program of 
displaying an image taken by at least one camera 
moved within a predetermined range by one or both of 
45 panning and tilting by camera moving means, compris- 
ing: 

codes of a process of designating a direction of a 
desired camera of the at least one camera; 

codes of a process of displaying a message indi- 
50 eating that the camera cannot be moved, when the 
direction designated by the direction designating step 
falls outside the predetermined range; and 

codes of a process of displaying an image taken 
by the desired camera. 
55 A computer readable memory storing a program of 
displaying an image taken by at least one camera 
moved within a predetermined range by one or both of 
panning and tilting by camera moving means, compris- 
ing: 
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codes of a process of designating a direction of a 
desired camera of the at least one camera; 

codes of a process of aiming the camera at a 
position closest to the direction designated by the direc- 
tion designating step, when the direction designated by 5 
the direction designating step falls outside the predeter- 
mined range; and 

codes of a process of displaying an image taken 
by the desired camera. 

The camera control system and method of the 10 
present invention with the above arrangements can 
designate an imaging inhibited area and thereby protect 
the privacy of a user. Additionally, since the imaging 
inhibited area can be set in a map window, the operation 
is easy and the imaging inhibited area can be clearly 15 
designated. 

Also, even if a direction in which a camera is to be 
aimed is outside the movable range of the camera, the 
movement of the camera is restricted within the camera 
movable range. This prevents a damage to the camera. 20 

Furthermore, an operator can set an imaging inhib- 
ited area and designate the direction of a camera while 
monitoring the view angle of the camera. This facilitates 
the operation. 

The directions or the magnifications of a camera 25 
can be instantaneously switched. 

Images such as are obtainable when a plurality of 
cameras are used can be obtained by using a single 
camera physically. 

Other features and advantages of the present 30 
invention will be apparent from the following description 
taken in conjunction with the accompanying drawings, 
in which like reference characters designate the same 
or similar parts throughout the figures thereof. 

35 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorpo- 
rated in and constitute a part of the specification, illus- 
trate embodiments of the invention and, together with 40 
the description, serve to explain the principles of the 
invention. 

Rg, 1 is a schematic block diagram showing the 
basic conf juration of a computer system according 45 
to one embodiment of the present invention; 
Fig. 2 is a schematic block diagram showing the 
hardware configuration of the embodiment in a net- 
work; 

Fig. 3 is a schematic block diagram showing the so 
software configuration of the embodiment in a net- 
work; 

Fig. 4 is a view showing an example of a camera 
display control panel displayed on a display 35 by a 
camera control client 56; 55 
Rg. 5 is a view for explaining setting of an imaging 
inhibited area; 

Rg. 6A is a flow chart showing processing of setting 
an imaging inhibited area; 



Rg. 6B is a flow chart showing the basic operation 
of a camera management server 50 with respect to 
the setting of an imaging inhibited area; 
Rg. 7 is a detailed flow chart of step S2 in Fig. 6B; 
Rg. 8 is a schematic view showing the correspond- 
ence between an imaging inhibited area and an 
imaging inhibited direction; 
Rg. 9 is a view showing an example of a camera 
status table; 

Rgs. 10A and 10B are schematic views showing 

the relationship between the pan enable direction 

and the imaging inhibited direction in case 1; 

Rg. 1 1 is a schematic view showing the relationship 

between the pan enable direction and the imaging 

inhibited direction in case 2; 

Rg. 12 is a schematic view showing the relationship 

between the pan enable direction and the imaging 

inhibited direction in case 3; 

Rg. 13 is a schematic view showing the relationship 

between the pan enable direction and the imaging 

inhibited direction in case 4; 

Rg. 14 is a schematic view showing the relationship 

between the pan enable direction and the imaging 

inhibited direction in case 5; 

Rg. 15 is a detailed flow chart of step S15 in Fig. 7; 

Rg. 16 is a view showing an example of a permitted 

host information file; 

Rg. 17 is a view for explaining another method of 
setting an imaging inhibited area; 
Rg. 18 is a view showing an example of a file for 
connecting set imaging inhibited areas and objec- 
tive cameras; 

Rg. 19 is a block diagram showing a common con- 
figuration applied to the second to fourth embodi- 
ments of a video camera controller according to the 
present invention; 

Rg. 20 is a view showing a common graphic user 
interface applied to the second to fourth embodi- 
ments; 

Rg. 21 is a view showing a common video camera 
control screen applied to the second to fourth 
embodiments and particularly explaining the sec- 
ond embodiment; 

Rg. 22 is a view showing an example of determina- 
tion of the camera movable range; 
Rg. 23 is a flow chart showing the operation of the 
second embodiment; 

Rgs. 24A and 24B are views showing an outline of 
the operation of the third embodiment; 
Rg. 25 is a view for explaining the operation of the 
third embodiment; 

Rg. 26 is a flow chart for explaining the operation of 
the third embodiment; 

Rg. 27 is a view showing an outline of the operation 
of the fourth embodiment; 
Rg. 28 is a view tor explaining the operation of the 
fourth embodiment; 

Rg. 29 is a flow chart for explaining the operation of 
the fourth embodiment; 
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Fig. 30 is a block diagram showing an outline ol the 
configuration of the fifth embodiment of the present 
invention; 

Fig. 31 is a view showing an example of the screen 
in the fifth embodiment; 

Fig. 32 is a view for explaining an input image and 
an extraction range; 

Fig. 33 is a flow chart of the fifth embodiment; 

Fig. 34 is a view showing an example of the screen 

when four extraction ranges are set; 

Fig. 35 is a view for explaining four extraction 

ranges set in an input image; 

Fig. 36 is a view showing a correspondence table of 

the extraction ranges and camera windows; 

Fig. 37 is a flow chart for explaining an operation 

when N virtual cameras are included in a system; 

and 

Fig. 38 is a view showing an example of a user 
interface for operating and displaying the extraction 
ranges. 

D ETAIL E D DES CRI P T IO N OF THE PR EF ERRE D 
EMBODIMENTS 

Embodiments of the present invention will be 
described below with reference to the accompanying 
drawings. 

[First Embodiment] 

Fig. 1 is a block diagram showing an outline of the 
configuration of a computer system in which a plurality 
of video communication terminals, i.e.. cameras, which 
are basic elements in this embodiment of the present 
invention, are connected. One or more computers hav- 
ing the configuration shown in Fig. 1 and/or one or more 
computers having a similar configuration are intercon- 
nected with each other via a computer network. 

In Fig. 1, camera control circuits 12 (12-1, 12-2, 12- 
3,...) directly control, e.g., panning, tilting, zooming, 
focus adjustment, and aperture of video cameras 10 
(10-1, 10-2, 10-3,..,) in accordance with external control 
signals. A camera input selector 14 selects a video 
camera 10 to be controlled and inputs an output signal 
from the camera. RS-232C is an example of a control 
signal line. However, the present invention is obviously 
not limited to this interface. Note that although an output 
signal is usually a video signal, a video signal and an 
audio signal are output if a camera with a microphone is 
used. In the following description it is assumed that only 
a video signal is output. 

A video communication terminal 20 sends a control 
command to a desired camera control circuit 1 2 via the 
camera input selector 14 and controls a video camera 
10 connected to the camera control circuit 12. Also, the 
video communication terminal 20 transmits an image 
picked-up by the selected camera to the network and 
receives images from the network A CPU 22 controls 
the overall system by executing programs stored in a 



main storage 24 and a secondary storage (e.g., a hard 
disk drive) 28. A mouse 28 is a pointing device. The 
mouse 28 and a keyboard 30 are used by an operator 
as input devices. 

s An I/O port 32 connects the camera input selector 
14 and supplies camera control commands to the cam- 
era input selector 14. A video board 34 inputs an output 
video signal from a video camera 10 selected by the 
camera input selector 14 and displays various images 

10 on a bit map display 35. A network interface 38 con- 
nects the video communication terminal 20 to a compu- 
ter network or a communication network. A system bus 
38 interconnects the devices from the CPU 22 to the 
network interlace 36. Through the network interface 36 

is it is possible to send a camera control signal from a 
remote place to the video communication terminal 20 
via the network and thereby control a given camera 10. 

The camera input selector 14 selects one of the 
control signal lines and one of the video outputs con- 

20 nected to the camera control circuits 12. The camera 
input selector 14 supplies the selected video output to 
the video board 34 and logically connects the selected 
control signal line to the I/O port 32. An NTSC signal 
which is a luminance/color-difference separation type 

25 signal is an example of the video signal format. The 
video board 34 inputs the video output selected by the 
camera input selector 14. The input video signal is dis- 
played as a dynamic image in a predetermined window 
of the bit map display 35 and/or transmitted to another 

30 terminal. 

The secondary storage 26 stores various informa- 
tion, e.g., camera position information data and camera 
graphic data, pertaining to the cameras 10 and other 
cameras connected via the network. Details of these 

35 pieces of information will be described later. 

If only one camera 10 is connected, the camera 
input selector 14 is unnecessary and one camera con- 
trol circuit 12 is directly connected to the I/O port 32. 
Also, if no video signals are transmitted, the cameras 

40 10, the camera control circuits 12, and the camera input 
selector 14 are unnecessary. 

The apparatus shown in Fig. 1 is connected as a 
communication terminal to a network as illustrated in 
Fig. 2. Not all communication terminals need to have 

45 the configuration shown in Fig. 1 . Fa example, the net- 
work can include a communication terminal to which 
only one camera is connected or a terminal to which no 
camera is connected (i.e., a terminal having a function 
of only remotely operating cameras connected to other 

so terminals and displaying images from these cameras). 
Generally, communication terminals having such vari- 
ous configurations simultaneously exist in a single net- 
work. As the network used in this embodiment, a LAN or 
a WAN having an enough transmission band width to 

55 transmit digital dynamic image data and camera control 
signals is assumed. Dynamic image data is usually 
compressed before being transmitted. In this embodi- 
ment, however, a detailed description of the dynamic 
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image compression method will be omitted since vari- 
ous existing methods are usable. 

The video board 34 has the video capture function 
as described above. The video board 34 supplies input 
video data to the bit map display 35 to display images s 
on it and also supplies the data to the CPU 22 through 
the bus 38. The CPU 22 packetizes the video data and 
outputs the packet to the network via the network inter- 
face 36. Packets of, e.g., a camera operation instruction 
and a camera switch instruction also are sent from the w 
network interface 36 to the network. Additionally, pack- 
ets of information pertaining to the overall system are 
sent to the network. These pieces of information are 
transmitted to either specif ied terminals or all terminals 
in accordance with the contents of data to be transmit- is 
ted and with the necessity. 

Reception is done in a similar fashion. That is. upon 
receiving packets of video data, a camera operation 
instruction, and a camera switch instruction, each video 
communication terminal 20 processes the received 20 
video data in the same manner as for internal capture 
data and processes the received camera operation and 
camera switch instructions in the same way as for anal- 
ogous internal instructions. The information pertaining 
to the overall system is used to update system display of 25 
a user interface (to be described later). 

Fig. 3 is a block diagram showing the software con- 
figuration in the system of this embodiment Referring to 
Fig. 3, the video communication terminals 20 and a 
camera management server 50 are connected to a 30 
computer network 52. A camera control server 54, a 
camera control client 56, and image transmitting/receiv- 
ing software 58 are installed in each video communica- 
tion terminal 20. The camera control server 54 controls 
the camera 1 0 in accordance with a camera control sig- 35 
nal (including a select signal if a plurality of cameras are 
connected) entered from the self-terminal or transmitted 
from another terminal. The camera control client 56 
remotely operates the camera 10 of the self-terminal or 
another terminal. The image transmitting/receiving soft- 40 
ware 58 supplies an image from the camera 10 of the 
self-terminal to other terminals via the network 52 and 
supplies images transferred from other terminals via the 
network 52 and an image from the camera 10 of the 
self-terminal to the display 35 of the self-terminal. 45 

The camera management server 5G is software for 
managing all cameras 1 0 available (or connected) to the 
network 52 and holds information such as the camera 
name, host name, installation position, and current sta- 
tus of each camera. The camera management server so 
50 also manages registration of a camera which is 
newly made usable via the network 52 and delete of a 
camera disconnected from the network 52. Additionally, 
the camera management server 50 periodically informs 
all camera control clients 56 of the management infor- 55 
mation of all cameras. The camera management server 
50 need only be stored in one of the terminals con- 
nected to the network 52. 



The camera control client 56 displays the locations 
and directions of the camera 10 of the self-terminal and 
all cameras usable via the network 52 on the screen of 
the display 35 of the self-terminal by superposing pre- 
determined camera symbols on a map. The camera 
control client 56 also updates the display state of each 
camera symbol in real time on the basis of the camera 
information periodically sent from the camera manage- 
ment server 50. 

The camera control server 54, the cameral control 
client 56, the camera image transmitting/receiving soft- 
ware 58, and the camera management server 50 are 
realized when the CPU 22 executes respective prede- 
termined programs. 

Fig. 4 shows an example of a camera display con- 
trol panel displayed on the display 35 by the camera 
control client 56. On a map showing the installation 
locations of operable cameras, a map window 60 super- 
poses camera icons indicating the locations and direc- 
tions of these cameras. A camera image window 62 
displays an image from one selected camera. A camera 
operation panel 64 includes various camera control but- 
tons and controls panning, tilting, and zooming of a 
selected camera. In this embodiment, it is assumed that 
a window display system capable of simultaneously dis- 
playing a plurality of windows is operating. 

The map window 60 displays a map showing, e.g.. 
the arrangement of seats in an office. On this map cam- 
era icons 66 indicative of the locations of individual 
cameras arranged in the office are superposed. Each 
camera icon 66 is displayed in the same position as the 
location of the conesponding camera and points in 
almost the same direction as the current camera direc- 
tion. These camera icons 66 are displayed in different 
colors to distinguish between a camera which is cur- 
rently selected to display an image or to be remotely 
operated, cameras used by other users, and cameras 
not used by anybody. 

The operation panel 64 is displayed below the cam- 
era image window 62. The operation panel 64 includes 
rotation operating buttons for panning and tilting and 
two buttons for a zoom operation. By operating these 
buttons, a user can operate rotation (panning and tilting) 
and zooming of a given designated camera. If an oper- 
ation of a selected camera is impossible (e.g., if the 
camera is already being operated by some other user), 
the rotation operating buttons and the zoom operating 
buttons are displayed in an operation disable state. 

For instance, when a certain user desires an 
access to (in this case a remote operation of) a certain 
camera, the user double-clicks the camera icon indicat- 
ing the camera of interest. In accordance with this dou- 
ble-click, the camera control client 56 reguests the 
camera management server 50 to issue the access 
right to that camera. If there is no user currently operat- 
ing that camera, the camera management server 50 
grants a permission to perform a remote operation 
(including display of an image) of the camera. If there is 
a user operating the camera, the camera management 
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server 50 denies the access right If the access right is 
granted, an output image from the camera is displayed 
in the camera image window 62 and operations (pan- 
ning, tilting, and zooming) from the camera operation 
panel 64 are enabled. 5 

Below the operation panel 64, a set button 68 for 
setting an imaging inhibited area and a clear button 70 
for canceling the set imaging inhibited area are dis- 
played. In this embodiment, sensing a scene of an 
imaging inhibited area by the cameras is inhibited. The jo 
imaging inhibited area can be set in a camera control 
system which remotely operates a desired camera 
within an entire range in which the camera is operable. 
The imaging inhibited area is set for designated cam- 
eras or all cameras under the camera control system. A is 
camera for which an imaging inhibited area is set can- 
not be remotely operated via the network to point in a 
direction in which the imaging inhibited area is sensed. 

The processing of setting an imaging inhibited area 
in this embodiment will be described in detail below. 20 

When a user clicks the imaging inhibited area set 
button 68, the camera control client 56 draws vertical 
and horizontal lines partitioning the map window 60 into 
a mesh as illustrated in Fig. 5. Areas divided by these 
vertical and horizontal lines are set units of an imaging 2s 
inhibited area. On the map window 60, the user desig- 
nates one or more divided areas in which he or she 
wants to inhibit sensing. The designated divided area 
(e.g., an area 92 in Fig. 5) is enclosed by, e.g., red so as 
to stand out dearly from other divided areas. When a 30 
desired divided area is selected as an imaging inhibited 
area, the user double-clicks the mouse button on the 
selected divided area. Consequently, an imaging inhib- 
ited area is set To cancel the imaging inhibited area, it 
is only necessary to click the clear button 70 by using 35 
the mouse. 

When the imaging inhbited area is set or changed, 
this information is supplied to the camera management 
server 50. The camera management server 50 changes 
the direction of a camera whose sensing range (field of 40 
view) includes the set or changed imaging inhibited 
area so that the imaging inhibited area is not sensed. 
Also, the direction of the corresponding camera icon 66 
is similarly changed on the map window 60. That is, the 
camera control client 56 operating in the communication 45 
terminal 20 in which the imaging inhibited area is set 
informs the camera management server 50 that the 
imaging inhibited area is set, and sends coordinate 
information of the set imaging inhibited area to the 
server 50. so 

Rg. 6A is a flow chart of the processing of the cam- 
era control client when an imaging inhibited area is set. 
This setting is done as described above. 

Fig. 6B is a basic flow chart of the camera manage- 
ment server 50 with respect to the setting and change of ss 
an imaging inhibited area The camera management 
server 50 acquires coordinate information (coordinates 
of opposite corners of a rectangle) of the set imaging 
inhibited area (step S1). The camera management 



server 50 searches for a camera whose current sensing 
range includes even a portion of the set imaging inhib- 
ited area. The camera management server 50 issues to 
the corresponding camera a camera control command 
for changing the direction of the camera to a direction in 
which the imaging inhibited area moves out of the sens- 
ing range, thereby changing the imaging direction of the 
camera (step S2). Also, the camera management 
server 50 informs ail camera control clients 56 of the 
changed direction of the camera whose direction is thus 
changed, and updates the direction of the correspond- 
ing camera icon 66 on the map window 60 (step S3). 

Rg. 7 shows a detailed flow chart of step S2 in Fig. 
6B. First a camera whose direction is to be changed 
and a camera whose rotatable angle is to be changed 
are selected (step Si 1). Assume that cameras in a seif- 
station locally connected to a host in which the imaging 
inhibited area is set are objective cameras. The camera 
management server selects these cameras by referring 
to host information of each camera. 

The direction and the rotatable angle of each 
selected camera are changed. That is, of the cameras 
selected in step S11, a camera i of interest (whose 
zoom lens is set to the telephoto side) is selected in step 
SI 2. From the coordinates of the installation position of 
the camera i and the coordinates of the imaging inhib- 
ited area, an imaging inhibited angle dd (d < 6d < D) in 
case that the optical system of the camera i is set to the 
widest angle is calculated as illustrated in Rg. 8 (step 
S1 3). Angles & and D are centered around the camera i 
at the two ends of the imaging inhibited area on the map 
plane. Camera control of the camera i is temporarily 
locked so that no user operates the camera i before the 
camera i is completely updated (step S14). From a cam- 
era status table (to be described later) and the imaging 
inhibited angle calculated in step S13, the pan enable 
angle of the camera i is changed so that the camera i 
does not aim in the imaging inhibited direction. If the 
camera i is currently pointing in the imaging inhibited 
direction, a camera control command which changes 
the direction of the camera so that the camera moves 
out of the imaging inhibited angle is transmitted to a cor- 
responding camera control server 54 (step S1 5). Details 
of this change processing will be described later. When 
the necessary change processing is completed, camera 
control lock of the camera i is released (step S16). 

The processing from step S13 to step S15 is exe- 
cuted for all of the cameras selected in step S11 by 
changing the camera of interest in steps S17 and $18. 

Rg. 9 shows an example of a camera status table 
901 storing fixed information and current information of 
each individual camera. The table 901 consists of infor- 
mation such as camera numbers, camera names, host 
names, the coordinates of the camera installation posi- 
tions on the map. initial directions upon start-up, pan 
enable angles 6p (a < Qp < A), and current directions. 
The two ends of the pan enable angle are angles a and 
A, similar to d and D, represented by clockwise angles in 
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a direction x (a predetermined direction on the map 
plane). 

The camera management server 50 constantly 
checks the camera status table and so monitors that the 
individual cameras do not rotate beyond the respective s 
pan enable angles. Also, the camera management 
server 50 periodically sends the contents of the camera 
status table to the camera control clients 56. On the 
basis of the information from the camera management 
server 50. each camera control client 56 updates the 
direction of each camera icon 66 in the map window 60 
displayed on the display 35. 

The relationships between the pan enable angle ep 
(a < 6p < A) and the imaging inhibited angle ed (d < ed 
< D) are classified into five cases described below. 

In case l,A>a>D>dora<A<d<Das illus- 
trated in Figs. 10A and 108. In this case the pan enable 
angle and the imaging inhibited angle do not overlap at 
all. 

In case 2.d<a<D<Aas shown in Fig. 1 1 . In this 
case a portion of the imaging inhibited angle overlaps 
the pan enable angle. 

In case 3, a<d<D<Aas shown in Fig. 12. In this 
case the imaging inhibited angle is entirely contained in 
the pan enable angle. 

In case 4, a <d < A < O as shown in Fig. 13. In this 
case a portion of the imaging inhibited angle overlaps 
the pan enable angle. 

In case 5.d<a<A<Das shown in Fig. 14. In this 
case the pan enable angle is entirely contained in the 30 
imaging inhibited angle. 

Fig. 15 shows the details of step S15 in Rg. 7. The 
camera status table 901 and the direction of the camera 
of interest are changed as follows in accordance with 
the five cases described above. Assume the current 35 
direction of the camera of interest is N. 

First, in step S21 which of the five cases is the cur- 
rent case is checked. 

If case 1 is determined, this means that the imaging 
inhibited angle and the pan enable angle do not overlap 40 
each other. Accordingly, no change is made (step S22). 

If case 5 is determined, this means that the pan 
enable angle is entirely contained in the imaging inhib- 
ited angle. Therefore, control and display of the camera 
are turned off {step S23). 45 

If case 2 is determined, the current direction N of 
the camera is checked (step S24). If a < N < D is deter- 
mined (YES in step S25), this means that the camera is 
currently aiming in the imaging inhibited area, and so 
the direction of the camera also needs to be changed, so 
Accordingly, in the camera status table 901 the angle D 
outside the imaging inhibited angle is substituted into 
the information of the current camera direction N and 
into the end portion a of the pan enable angle (step 
S26). Thereafter, a pan command for aiming the cam- ss 
era in the angle O is issued (step S27). 

Cases 3 and 4 are basically the same as case 2. In 
these cases, the pan enable angle is so changed as not 
to contain the imaging inhibited angle, and the direction 



of a camera pointing to the imaging inhibited angle is so 
changed that the camera does not aim at the imaging 
inhibited angle (steps S28 to S36). If a camera is point- 
ing to the imaging inhibited angle in case 3. the camera 
is aimed at the angle D. However, it is also possible to 
point the camera to the angle & or to a larger end portion 
by comparing (A - D) with (d - a). 

In the above embodiment, the imaging inhibited 
area is chosen from equally divided areas on the map. 
However, it is evident that a rectangle with a given size 
drawn on the map by dragging the mouse can also be 
set as an imaging inhibited area. In this case each user 
can set an imaging inhibited area with a given size. 

In the above embodiment after the imaging inhib- 
ited area is set, only cameras connected to the local 
host are chosen as a camera whose pan enable angle 
and direction of the cameras are to be changed. 
Accordingly, H is possible to impose limitations on the 
directions of the cameras in the self-station. Conse- 
quently, other users cannot remotely aim the cameras in 
the self-station in the direction of an area set as the 
imaging inhibited area. However, if only local cameras 
are the objects, the number of cameras whose camera 
operations can be restricted is limited. In situations 
where a large number of cameras exist, therefore, even 
if an imaging inhibited area is set it is sometimes possi- 
ble to take an image of this imaging inhibited area from 
a camera of another host. Also, it is sometimes neces- 
sary to limit the operation of a certain camera from other 
hosts rather than a local host. 

This objective or demand can be achieved by mak- 
ing an extension such that cameras connected to other 
hosts can also be set as a camera whose pan enable 
direction and imaging direction are changed in accord- 
ance with setting (or change) of an imaging inhibited 
area. This extension is made as follows. 

Camera access permitted hosts are predetermined 
for each camera. As an example, a permitted host infor- 
mation file as shown in Fig. 16 is formed. If an imaging 
inhibited area is set on the map of host 1 , for example, 
afi cameras connected to all hosts to which a remote 
operation by host 1 is permitted are retrieved from the 
permitted host information file and set as objects to be 
changed. If all host names are set for a certain camera, 
it is of course possible to inhibit any camera from being 
aimed at the imaging inhibited area. If this is the case, 
the imaging inhibited area can never be imaged. 

It is unnecessary to select an imaging inhibited 
area from equally divided areas on the map. For exam- 
ple, as illustrated in Fig. 17, it is possible to preset sev- 
eral areas with arbitrary sizes which may be set as an 
imaging inhibited area, store the position information of 
these areas, and, when an imaging inhibited area is to 
be set (changed), display these areas on the map so 
that any area can be selected. Accordingly, areas which 
can be set as an imaging inhibited area and areas which 
cannot can be distinguished in accordance with the 
user. As an example, a common place which is strongly 
public cannot be set as an imaging inhibited area when 
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an imaging inhibited area is set (changed), it the place 
is not set as a candidate of an imaging inhibited area. 

It is also possible to limit cameras (or hosts) whose 
operations are limited by an imaging inhibited area for 
each set imaging inhibited area. If this is the case, as 
illustrated in Fig. 18. a file connecting objective cameras 
to each set imaging inhibited area is formed. In Fig. 18. 
if area 1 is chosen as an imaging inhibited area, cam- 
eras 1 . 2. 3, and 5 are set as cameras whose pan is lim- 
ited. This allows a rapid retrieval of cameras covering 
the imaging inhibited area. 

In the above description, general users can freely 
set and cancel an imaging inhibited area. However, it is 
naturally also possible to permit only a specific manager 
to do these works. For example, a system manager or a 
direct manager of an objective camera (e.g., the user of 
a video communication terminal connected to the cam- 
era) can set an imaging inhibited area of each camera 
under the management and can change and cancel the 
setting. However, general users cannot set imaging 
inhibited areas of cameras which they do not manage 
and cannot change and cancel already set imaging 
inhibited areas. 

As can be readily understood from the above expla- 
nation, in the present invention an imaging inhibited 
area which is inhfaited from being imaged by a camera 
can be set on a map showing the arrangement of cam- 
eras. This makes rt possible to protect the privacy of 
each user. Also, an operation for this purpose can be 
done by a readily understandable interface. 

[Second Embodiment] 

The second embodiment of the present invention 
will be described in detail below with reference to the 
accompanying drawings. 

Fig. 19 is a block diagram showing a video commu- 
nication terminal of this embodiment A display 100 as a 
display unit displays a video camera control window 10, 
Fig. 20. A video camera 101 incorporating a zoom lens 
can be panned and tilted by a panhead 109 which incor- 
porates a motor (not shown). The motion of the video 
camera 101 is controlled by a video camera controller 
102. An image controller 103 encodes and decodes 
image signals. A communication controller 104 
exchanges image information and video camera control 
information with a video camera controller installed in a 
remote place. A system controller 105 controls the over- 
all system. An operation unit 106 as a designating 
means includes a keyboard, a mouse, and a digitizer 
and inputs designations to the system controller 105. 
These controllers constitute a control means according 
to this embodiment. 

The configuration in Fig. 19 is equivalent to setting 
one video camera and omitting the camera input selec- 
tor 14 in the configuration in Fig. 1. That is. the system 
controller 105, the video camera controller 102, the 
image controller 103, and the communication controller 
104 correspond to the video communication terminal 



20, the camera control circuit 12, the video board 34. 
and the network l/F 36. respectively. Accordingly, a plu- 
rality of cameras can also be controlled by adding the 
camera input selector 14 to the configuration in Fig. 19. 
5 Fig. 20 shows a graphical user interface (GUI) on a 
screen 100a of the display 100. 

A video camera control window 1 10 includes an 
image display screen 111, a video camera control 
screen 1 12. camera direction control buttons 1 13, 1 14, 
w 115, and 116, and sensing range (field of view) control 
buttons 1 1 7 and 1 1 8. The image display screen 1 1 1 dis- 
plays an image currently being picked-up by the video 
camera 101. The video camera control screen 112 is 
used to control the motion of the video camera 101. The 
is camera direction control buttons 1 1 3, 1 1 4. 1 1 5, and 1 1 6 
are used to change the camera direction upward, to the 
left, downward, and to the right respectively, without 
using the video camera control screen 112. The sensing 
range control buttons 1 1 7 and 1 18 are used to enlarge 
so and reduce (zoom in and zoom out), respectively, an 
image of an object. The control window 110 also dis- 
plays a cursor 1 19 for operating the control window 1 1 0. 
This cursor 119 is operated by the operation unit 106 
(Fig. 1). The control window 110 further includes a but- 
25 ton 107 for designating an imaging inhtoited range and 
a clear button 1 08 for canceling the range designated by 
the button 107. 

Fig. 21 is an enlarged view of the video camera 
control screen 1 12. Referring to Fig. 21 . a sensing ena- 
30 We area 1 1 2a indicates a range which can be sensed by 
the video camera 101 when the zoom magnification is 
minimized (to the widest angle) and panning and tilting 
are performed over the entire range. The sensing ena- 
ble area 1 12a has the same size as the video camera 
35 control screen 1 1 2. A video camera movable area 1 1 2b 
indicates a range within which the optical axis of the 
video camera 101 can move. A sensing range display 
area 1 12c indicates a position and a range in the sens- 
ing enable area 112a which the video camera 101 is 
40 currently sensing. Although the size of the sensing ena- 
ble area 112a is fixed, the sensing range display area 
112c changes its size in accordance with the zoom 
magnification. 

The video camera control screen 1 12 is displayed 
45 in place of the map display window 60 in the first 
embodiment. In the apparatus of this embodiment, it is 
assumed that one camera is connected to one video 
communication terminal. Accordingly, by displaying the 
sensing angle based on the visual field of the connected 
so camera, the sensing enable range and the camera 
rotatable angle can be shown to the user. 

Designation of an imaging inhibited range is done 
by the button 107. The button 107 has the same func- 
tion as the button 68 in the first embodiment. When the 
55 button 107 is depressed, the map window 60. Fig. 5. in 
which the arrangement of cameras and already divided 
areas are drawn is displayed, and an imaging inhibited 
area is designated on this map. In the same fashion as 
in the first embodiment, an angle at which cameras are 
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inhibited from being aimed is calculated as shown in 
Fig. 8 and registered as a camera status table 901 , Fig. 
9. Although the table in Fig. 9 does not contain a cam- 
era tilt angle, in this embodiment it is assumed that the 
camera status table contains the tilt angle. 5 

When the imaging inhibited area is thus desig- 
nated, an angle at which a camera is rotatable is dis- 
played on the camera control screen 1 12, in place of the 
map window 60, on the basis of the contents of the cam- 
era status table. In this case the camera movable area w 
1 12a is determined on the basis of a pan enable angle 
(a. A) registered in the camera status table 901. Note 
that the pan enable angle and the tilt enable angle 
excluding the imaging inhibited angle will be collectively 
referred to as a camera movable range hereinafter. is 

Fig. 21 shows an example in which no imaging 
inhibited area is designated. If an imaging inhibited area 
is designated, as shown in Fig. 22, a permitted camera 
movable range is obtained by projecting the pan enable 
range of the camera onto a plane. This corresponds to 20 
the position and length in the horizontal direction of the 
camera movable area 11 2b and determines the posi- 
tions of vertical lines 112b-1 and 112b-2 of the area 
112b. 

An imaging inhibited area also can be designated 25 
on the camera control screen 1 1 2 in Fig. 21 . That is. the 
camera movable area is directly designated by an oper- 
ator by dragging the vertical line 1 12b-1 or 1 12b-2 and 
moving the line to a desired position by using the 
mouse. In this case the angles (A, a) at the two ends of 30 
the pan enable angle are calculated from the permitted 
camera movable area by a procedure which is the 
reverse of the procedure in Fig. 22. 

A control procedure performed by the system con- 
troller 105 when an operator operates the camera on 35 
the camera control screen 112 thus obtained will be 
described below with reference to the flow chart in Fia 
23. 

The user operates the video camera control screen 
1 12, the camera direction control buttons 1 13 to 1 16, or 40 
the sensing range control buttons 117 and 118 in the 
video camera control window 1 10 by using the cursor 
1 9, thereby controlling the video camera 1 10 to take an 
image of a desired location (step S230). 

The coordinates of the selected camera direction 45 
are detected (step S231). An area on the camera con- 
trol screen in which the selected coordinates are 
present is checked (step S232). 

In this embodiment, if the user selects a position 
outside the video camera movable area on the video so 
camera control screen 1 12 in Fig. 21 by using the cursor 
119 (119-1). an error is determined because the 
selected position is outside the video camera movable 
area, and nothing is done for the operation control of the 
video camera 101 . Preferably, to inform the user that the 55 
selection is an error, a message 'position outside cam- 
era movable area is selected" is displayed on the video 
camera control screen 1 12 (step S234). It is also possi- 
ble, without displaying this message, to inform the user 



that the position cannot be selected, by replacing the 
cursor 119-1 indicating the position outside the video 
camera optical axis movable area with a symbol indi- 
cated by reference numeral 119-2, which is a cursor 
with a mark V on it. 

On the other hand, if the designated direction is 
within the camera movable area, the camera is aimed in 
that direction, and the camera status table is updated 
(steps S233 and S237). If the object camera to be oper- 
ated is a remote-controlled camera, control information 
for rotating the camera is transmitted to a system control 
unit of the object camera (step S236). 

With the above control it is possible to prevent a 
damage to the panhead 109 even if the selected posi- 
tion is outside the video camera movable area. Also, an 
error message is displayed although the video camera 
101 does not move, so the user can instantly know that 
the selection is an error. 

ft is readily possible to determine that the selected 
place is outside the video camera movable area, when 
the system controller 105 calculates the coordinates of 
the selected place and detects that the calculated coor- 
dinates are outside the video camera movable area 
112b and inside the imaging enable area 112a. More 
specifically, a method in the third embodiment is appli- 
cable. If the system controller 105 detects that the 
selected place is outside the video camera movable 
area, the message described above can be displayed 
on the display 1 00 via the image controller 1 03. 

In the above embodiment, the video camera 101 is 
not operated if the selected place is outside the video 
camera movable area. However, the following effect can 
be obtained by operating the video camera controller 
102 to set zooming of the video camera 101 to the wid- 
est-angle without panning and tilting the camera. That 
is, the user selected the place because he or she 
wanted to see the place. Therefore, it is desirable that 
the selected place be displayed even though the place 
is not displayed in the center of the screen. If the optical 
axis of the video camera 101 positions at the edge por- 
tion of the video camera movable area 1 12b, an image 
of the selected place (outside the camera movable area, 
in this case) can sometimes be displayed by setting 
zooming of the camera to the widest-angle. If this is the 
case the desire of the user is satisfied. 

[Third Embodiment] 



In this embodiment, the content in step S235 of Fig. 
23 in the second embodiment is changed. In the second 
embodiment, as described above, even if the place 
selected by the user is outside the video camera mova- 
ble area, the user selected the place because he or she 
wanted to see the place. Therefore, it is desirable that 
the selected place be displayed even though the place 
is not displayed in the center of the screen. In this 
embodiment, this desire is positively satisfied. This 
embodiment will be described in detail below with refer- 
ence to the accompanying drawings. Note that the sys- 
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tern configuration is identical with that of the second 
embodiment shown in Fig. 19 and the GUI is also simi- 
lar to that of the second embodiment shown in Fig. 20, 
and so detailed descriptions thereof will be omitted. 

Figs. 24A and 24B illustrate operations on a video s 
camera control screen 112. Fig. 24A shows a normal 
operation in which the user selects a position inside a 
video camera movable area 1 12b as a new object to be 
sensed. Fig. 24B shows a case where the user selects 
a position outside the video camera movable area 112 io 
as a new object to be sensed. 

Referring to Fig. 24A, a cursor 1 1 9 is moved by an 
operation unit 106 such as a mouse to select a prede- 
termined position, a coordinate point 120 in this case, 
thereby moving an imaging range display area from an 15 
area 1 1 2c to an area 11 2d. An image in this new area 
1 12d is displayed on an image display screen 1 1 1 (Fig. 
20). In this case the zoom magnification is not altered 
and the imaging direction of a video camera 101 is so 
changed that the selected coordinate point 120 is dis- so 
played in the center of the screen. 

In Fig. 24B, as in the case of Fig, 24A, the sensing 
range display area is moved from the area 1 12c to the 
area 1 1 2d by selecting the coordinate point 120. Since 
the selected coordinate point 120 is outside the video 2S 
camera movable area 1 12b, it is not possible to change 
the sensing direction of the video camera 101 toward 
that position. Therefore, an intersection 123 of a straight 
line 122 connecting a central coordinate point 121 of an 
imaging enable area 1 12a and the selected coordinate 30 
point 120 and the frame of the video camera movable 
area 1 12b is set as a new imaging screen center. How- 
ever, if the camera direction is changed without chang- 
ing the zoom magnification, the selected coordinate 
point 120 (in Fig. 24B) sometimes does not come into 3s 
the sensing range as indicated by the positional rela- 
tionship between the sensing range display area 1l2d 
and the selected coordinate point 120. Therefore, the 
zoom magnification is minimized (to the widest angle). 
By the above control, the selected coordinate point 1 20 40 
is contained in an area 1l2e broader than the sensing 
range display area 1 12d. and this makes sensing at the 
selected coordinate point 120 possible. 

Details of the operation of the video camera control 
method in this third embodiment will be described below 45 
with reference to Figs. 25 and 26. Fig. 25 illustrates the 
sensing enable area 1 1 2a as a plane having a size of m 
x n. Coordinates are written in this plane, and the plane 
is divided into a plurality of areas. Reference numerals 
in Fig. 25 are the same as in Fig. 24B. Fig. 26 is a flow so 
chart showing the operation of a system controller 105. 
Corresponding step numbers are given in parentheses. 

The user operates the operation unit 106 to move 
the cursor 1 19 in a video camera control window 1 1 0 on 
a screen 1 10a of a display 100. selecting a place to be 55 
sensed (step S100). 

The system controller 105 detects coordinates 
(Xp.Yp) 120 of the position of the cursor 1 19 when the 
place to be sensed is selected in step S100 (step S101). 



The system controller 105 checks which of areas A, 
B. C, D. and E the selected coordinate point (Xp.Yp) 120 
belongs to (step S1 02). 

If the system controller 105 determines in step 
S102 that the selected coordinate point (Xp,Yp) 120 is 
within the area A, i.e., the video camera movable area 
112b, it is unnecessary to change the zoom value. 
Accordingly, the system controller 105 calculates the 
moving amount of the video camera (step S103). 

On the other hand, if the system controller 105 
determines in step S102 that the selected coordinate 
point (Xp.Yp) 120 is in any of the areas B, C. D, and E 
outside the video camera movable area 1 1 2b, the sys- 
tem controller 105 calculates coordinates of a new 
sensing center 123 (step S104). For example, if it is 
determined that the selected coordinate point (Xp.Yp) 
120 is in the area B as illustrated in Fig. 25, the new 
sensing center (the position of the optical axis of the 
video camera 101) 123 is calculated as follows. 

That is, assuming the coordinates of the center in 
the sensing enable area 1 12a are (Xc.Yc). the straight 
line 122 passing the selected coordinate point (Xp.Yp) 
120 and the central coordinate point (Xc.Yc) 121 is 
given by 

(y - Yc)(Xp - Xc) = (x - Xc)(Yp - Yc) 

Since the frame of the video camera movable area 1 12b 
in contact with the area B is 

y = Yb 

the coordinates of the new imaging center 123 as an 
intersection of the straight line 122 and the frame of the 
video camera movable area 1 12b are calculated by 

((Yb • Yc)(Xp - Xc)/(Yp - Yc) + Xc.Yb) 

The system controller 105 then calculates the 
amount of movement to the new sensing center 123 cal- 
culated in step S104. If an operation of minimizing the 
zoom magnification (to the widest angle) is also to be 
performed, the system controller 1 05 performs a calcu- 
lation for the operation (step Si 05). 

Subsequently, the system controller 105 checks 
whether the video camera 101 as an object to be con- 
trolled is connected to a video camera controller in a 
remote place or can be controlled by the controller 105 
(step S106). 

If the system controller 105 determines in step 
S106 that the video camera 101 is connected to a video 
camera controller in a remote place, the system control- 
ler 105 transmits the video camera control information 
calculated in step S103 or Si 05 to the video camera 
controller in the remote place via a communication con- 
troller 104 (step S107). 

rf the system controller 105 determines in step 
S106 that the video camera 101 can be controlled by 
the controller 105, the system controller 105 moves the 
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camera direction and changes the 200m magnification 
of the video camera 101 on the basis of the control infor- 
mation of the video camera 1 01 calculated in step S103 
orSl05(stepS108). 

By repeating the operation from step S100 to step 5 
S1 08 described above, it is possible to pick-up an image 
of a given object located in the sensing enable range of 
the video camera 101 as an object to be controlled. 

In the processing of this embodiment, interrupt is 
accepted. Interrupt occurs when the user completes the 10 
operation of the system (step Si 09), and the processing 
is ended. 

In this embodiment as described above, even if a 
place selected by the user is outside the video camera 
movable area, the video camera 101 is moved to the 15 
limit toward the position selected by the user and 
stopped at that limiting position, and an image corre- 
sponding to the field of view of the video camera 101 is 
displayed. Accordingly, no additional load is applied on 
the camera driver and an image of the selected place or 20 
of the selected place and its vicinity is taken (displayed). 
Consequently, the desire of the user to seethe selected 
place can be satisfied. Also, the camera cannot be 
pointed to the designated imaging inhibited area even rf 
the user attempts to aim the camera in that direction. 25 

Furthermore, when the zoom magnification is mini- 
mized (to the widest angle), an image of the selected 
place can be reliably taken (displayed). 

[Fourth Embodiment] 30 

The fourth embodiment is obtained by further 
improving the third embodiment. This fourth embodi- 
ment will be described below with reference to the 
accompanying drawings. The configuration, GUI, and 35 
video camera control screen of a video camera control- 
ler are the same as in the second and third embodi- 
ments, and so Figs. 19. 20, and 21 are again used for 
these parts. 

An outline of the operation of a video camera con- 40 
trof method according to the fourth embodiment will be 
described with reference to Fig. 27. Fig. 27 shows an 
operation on the video camera control screen, Fig. 21. 
Note that an operation when the user selects a video 
camera movable area as a new object to be imaged is 45 
the same as the operation, Fig. 24A, explained in the 
third embodiment, and so a detailed description thereof 
will be omitted. 

Fig. 27 shows an example when the user selects a 
petition outside the video movable area as a new object so 
to be sensed. In Fig. 27, it is impossible to change the 
direction of a video camera 101 such that a selected 
coordinate point 130 comes to the center of the screen, 
since the selected coordinate point is outside a video 
camera movable area 1 12b. Therefore, a point 131 on ss 
the frame of the video camera movable area 112b. 
which is closest to the selected coordinate point 130, is 
set as the center of a new sensing range. However, if 
the camera direction is changed without changing the 



zoom magnification, the selected coordinate point 130 
sometimes does not come into the sensing range as 
indicated by the positional relationship between a sens- 
ing range display area I12d and the selected coordi- 
nate point 130. Therefore, the zoom magnification is 
minimized (to the widest angle). By the above control, 
the selected coordinate point 130 is included in a sens- 
ing range display area 112e, and this makes scene 
sensing possible. 

Details of the operation of the video camera control 
method according to the fourth embodiment will be 
described below with reference to Figs. 28 and 29. Fig. 
28 illustrates a sensing enable area 1 1 2a as a plane 
having a size of m x n. Coordinates are written in this 
plane, and the plane is divided into a plurality of areas. 
Reference numerals in Fig. 28 are the same as in Fig, 
27 Fig. 29 is a flow chart showing the operation of a 
system controller 105. 

The user operates an operation unit 106 to move a 
cursor 119 in a video camera control window 10 on a 
screen 100a of a display 100, selecting a place to be 
sensed (step $200). 

The system controller 105 detects the coordinates 
(Xp.Yp) of the position of the cursor 1 1 9 when the place 
to be sensed is selected in step S200 (step S201). 

Subsequently, the system controller 105 checks 
which of areas A, B. C. D. E, F. G, H. and I the selected 
coordinate point 130 (Xp.Yp) belongs to (step S202). 

If the system controller 105 determines in step 
S202 that the selected coordinate point (Xp.Yp) is within 
the area A, i.e., the video camera movable area 1 12b, it 
is not necessary to change the zoom value. Accordingly, 
the system controller 105 calculates only the moving 
amount of the video camera 101 (step S203). 

If the system controller 105 determines in step 
S202 that the selected coordinate point 130 (Xp.Yp) is 
within any of the areas B. C, D. E. F, G, H, and I outside 
the video camera movable area 1 12b, the system con- 
troller 105 calculates the coordinates of the center 131 
of the new sensing range (step S204). A method of cal- 
culating the center 131 of the new sensing range when 
it is determined that the selected coordinate point 130 
(Xp,Yp) is in the area B as illustrated in Fig. 28 is as fol- 
lows. 

The point 131 on the frame of the video camera 
movable area 11 2b, which is closest to the selected 
coordinate point 130 (Xp.Yp), can be easily obtained by 

(Xp.Yb) 

since the point 131 is the intersection of a boundary line 
y = Yb 

between the area B and the video camera movable area 
1 12b and a perpendicular 

x = Xp 
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from the selected coordinate point 130 (Xp.Yp) to the 
straight line y = Yb. That is. when the area B is 
selected, the X coordinate of the new position of the 
video camera 101 can be determined from the selected 
coordinate point 130 (Xp.Yp), and the Y coordinate is 5 
unconditionally Yb. Similarly, when the area F is chosen 
the Y coordinate is unconditionally Yf. When the areas 
D and H are chosen, the X coordinates are uncondition- 
ally Xd and Xh, respectively, although the Y coordinates 
are respective designated values. w 

When the selected coordinate point 130 belongs to 
any of the areas C, E, G, and I, the coordinate point at 
the corner of the video camera movable area 112b. 
which is closest to the selected coordinate point 130, is 
unconditionally set as the new center point 131 without is 
performing the above calculations. For example, if the 
coordinate point (Xp.Yp) is contained in the area C, a 
corner point 133 is set as the imaging center. 

The system controller 1 05 then minimizes the zoom 
magnification (to the widest angle) and calculates the 20 
amount of movement to the new center point 131 calcu- 
lated in step S204 (step S205). 

Subsequently, the system controller 105 checks 
whether the video camera 101 as an object to be con- 
trolled is connected to a video camera controller in a 25 
remote place or can be controlled by the controller 105 
(stepS206). 

If the system controller 105 determines in step 
S206 that the video camera is connected to a video 
camera controller in a remote place, the system control- 30 
Jer 105 transmits the video camera control information 
calculated in step S203 or S205 to the video camera 
controller in the remote place via a communication con- 
troller 104 (step S207). 

If the system controller 105 determines in step 35 
S206 that the video camera 101 can be controlled by 
the controller 105, the system controller 105 changes 
the camera direction and the zoom magnification of the 
video camera 101 on the basis of the control information 
of the video camera 101 calculated in step S203 or 40 
S205 (step S208). 

By repeating the operation from step S200 to step 
S208 described above, it is possible to take an image of 
a given object located in the sensing enable range of the 
video camera 1 01 as an object to be controlled. 45 

In the processing of this embodiment, interrupt is 
accepted. Interrupt occurs when the user completes the 
operation of the system (step S209), and the processing 
is ended. 

In this embodiment as described above, even if a so 
place selected by the user is outside the video camera 
movable area, the video camera 101 is moved to the 
limit toward the position selected by the user and 
stopped at that limiting position, and the zoom magnifi- 
cation of the video camera 101 is minimized (to the wid- 55 
est angle). Accordingly, no additional load is applied on 
the camera driver and an image of the selected place is 
picked-up (displayed). Consequently, the desire of the 
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user to see the selected place can be satisfied. Also, the 
camera cannot be pointed in an imaging inhibited area. 

In the systems of the first to fourth embodiments as 
described above, even if a place selected by the user is 
outside the video camera movable area, the driver for 
changing the direction of a video camera is not dam- 
aged. Also, the user can limit the camera movable 
range, and the camera cannot be pointed in that direc- 
tion. 

Additionally, the user can instantly know that the 
selection is an error even though the video camera does 
not move. 

Furthermore, even if a place selected by the user is 
outside the video camera movable area, the video cam- 
era is moved to the limit toward the position selected by 
the user and stopped at that limiting position, and an 
image corresponding to the view angle of the video 
camera is displayed. Accordingly, no additional load is 
applied on the camera driver and an image of the 
selected place or of the selected place and Hs vicinity is 
picked-up (displayed). Consequently, the desire of the 
user to see the selected place can be satisfied. 

An image of the selected place can be reliably 
picked-up (displayed). 

An area outside the video camera movable area 
can be processed as four portions, and this facilitates 
the processing. 

An area outside the video camera movable area 
can be divided into a plurality of areas, and each individ- 
ual area can be unconditionally processed. 

[Fifth Embodiment] 

The fifth embodiment of the present invention will 
be described in detail below with reference to the 
accompanying drawings. This embodiment relates to a 
technique by which an object to be sensed is changed 
without moving a camera in the systems of the first to 
fourth embodiments. 

Fig. 30 is a block diagram showing an outline of the 
configuration of the fifth embodiment of the present 
invention. Referring to Rg. 30. a CPU 22 for controlling 
the overall system, a main storage 24 of the CPU 22, a 
bit map display 35, a mouse 28, a network interface 36, 
and a frame memory 320 are connected to a bus 38. 

A video capture unit 326 converts an output video 
signal from a video camera 10 into a digital signal and 
outputs the signal to the frame memory 320. An object 
lens of the video camera 10 is a high-resolution, wide* 
angle lens capable of picking-up an image of large area 
within the field of view of the lens. An image pick-up 
means of the video camera 10 is desirably a Highvision 
camera or a device with a higher resolution. 

Fig. 31 shows an example of the display screen of 
the display 35. A window system capable of displaying a 
plurality of overlapped windows is operating on the dis- 
play 35. In Fig. 31 , an image display window 330 and an 
operation panel 332 are displayed. The image display 
window 330 displays a portion of an image picked-up by 
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the vkieo camera 10. The operation panel 332 is used 
to designate which portion of the input image from the 
video camera 1 0 is to be displayed on the image display 
window 330. and to designate the magnification at 
which the selected image portion is displayed. The 
operation panel 332 includes a button 338 for designat- 
ing an imaging inhibited area and a clear button 339. 
The operation panel 332 further includes a position des- 
ignation panel 334 and a magnification designation 
panel 336. The position designation panel 334 is used 
to designate a portion of the input image from the video 
camera 10 which is to be displayed in the image display 
window 330. The magnification designation panel 336 is 
used to designate the magnification of the image dis- 
played in the image display window 330. 

In this embodiment, designation of the imaging 
inhibited area is done in the same manner as in the 
fourth embodiment. Therefore, a detailed description of 
a procedure of the designation will be omitted. 

Fig. 32 shows the relationship between an image 
(input image) picked-up by the video camera 10 and 
stored in the frame memory 320 and an image (display 
image) displayed in the image display window 330. Ref- 
erence numeral 340 denotes an input image, i.e., an 
image which is picked-up by the video camera 10 and 
stored in the frame memory 320 by the video capture 
unit 326 and from which an imaging inhibited area is 
excluded. Reference numeral 342 denotes an area 
extracted from the input image 340 and displayed in the 
image display window 330. If the extraction area 342 is 
outside the input image 340, fixed-color data or the like 
is displayed in this outside portion. This allows a user to 
readily recognize on the screen that he or she is 
attempting to see a portion outside the sensing range or 
a portion outside the imaging inhibited area. Therefore, 
except in such a case or portion, the extraction area 342 
generally coincides with the display image. 

Assuming that the vertical and horizontal directions 
on the imaging screen of the camera 10 are x and y 
axes, respectively, the angles in the x and y directions 
are represented by 6 and respectively, and e = 0, * = 
0, x = 0, and y a 0 in the center of the input image, the 
central coordinates (xl.yi) of the display image are rep- 
resented by 



xi » LtanO 
yl « Ltan<|> 

where L is a constant. The display area to be extracted 
from the input image is determined by this origin coordi- 
nate point (xl.yf) and the display magnification. The 
higher the display magnification the smaller the vertical 
and horizontal dimensions of the extraction area. 

The pixel density of the image extracted from the 
extraction area 342 is so converted as to meet the 
number of pixels in the image display window 330. 
Assuming, for example, that the numbers of pixels in the 
image display window 330 are H (vertical) x W (horizon- 



tal) and the numbers of pixels in the area extracted from 
the input image are h (vertical) x w (horizontal), H and 
W rarely equal h and w. respectively. Generally, the pixel 
data in the extraction range is interpolated and thinned 
5 so as to meet the number of pixels in the image display 
area of the image display window 330. Various known 
methods are usable as this pixel density conversion 
method. 

The center (xl.yl) of the extraction area 342 can be 
10 freely designated by operating four^Jirection keys on 
the position designation panel 334 by using the mouse. 
Also, an arbitrary display magnification can be desig- 
nated on the magnification designation panel 336. The 
vertical (h) and horizontal (w) dimensions of the extrac- 
ts tion range 342 are determined by the magnification des- 
ignated on the magnification designation panel 336 and 
the vertical and horizontal dimensions of the image dis- 
play window 330. 

The image in the extraction area 342 is displayed 
20 on the display 35 or transmitted to a remote place via 
the network interface 36. 

In this embodiment, ti!t(8), panfo). and zoom(z). the 
same commands as used in a camera operation com- 
mand system, are used in a command system for 
25 changing the center of the extraction area 342. Tilt(e) is 
a command for tilting in the vertical direction, pan(<|>) is a 
command for panning in the horizontal direction, and 
zoom(z) is a command for zooming. 

That is, the tilt command is assigned to the vertical 
30 keys on the position designation panel 334. While these 
keys are depressed, the CPU 22 increases or 
decreases the angle 6 to generate a tiit(6) command. 
The pan command is assigned to the horizontal keys on 
the position designation panel 334. While these keys 
35 are depressed, the CPU 22 increases or decreases the 
angle 4> to generate a pan(<j>) command. The zoom com- 
mand is assigned to the scroll bar on the magnification 
designation panel 336. In accordance with the move- 
ment of this scroll bar, the CPU 22 generates a zoom(z) 
40 command of a magnification i meeting the movement 
The tilt and pan commands change the center of 
the area 342 extracted from the frame memory 320. and 
the zoom command changes the size of the extraction 
area 342. These commands can be transmitted to a 
45 remote plate via the network 36. That is, it is possible to 
remotely change the area extracted from a frame mem- 
ory in an apparatus with the same configuration as in 
Fig. 30 installed in a distant place. 

Fig. 33 shows the flow of a procedure from imaging 
so to image display in this embodiment. A dynamic image 
can be reproduced and displayed if this procedure is 
executed within one frame cycle of a dynamic image. 

Referring to Fig. 33, steps S334 and S335 corre- 
spond to a control procedure done by a video communi- 
55 cation controller 20. When an image is input from the 
camera 10 (step S331), the video capture unit 326 
writes the image data into the frame memory 320 (steps 
S332 and S333). in accordance with the tilt angle, pan 
angle, and zoom magnification designated on the pan- 
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eis 334 and 335. the extraction area 342 is determined 
and the image is extracted as shown in Fig. 32 (step 
S334). The extracted image is converted to meet the 
size of the window 330 in which the image is to be dis- 
played (step S335). The converted image is then output 
and displayed (step S336). 

The above procedure is executed for a local camera 
or by a client in a remote place. To operate a camera in 
a distant place, the tilt, pan, and zoom commands are 
generated and transmitted to a controller of the camera 
in that place. 

If the pan, tilt, and zoom operations are performed 
for the same camera, it is only necessary to execute 
steps S334 and S335. 

As described above, the display direction and width 
can be changed by electronically changing the area 342 
extracted from the frame memory 320. Accordingly, it is 
possible to obtain essentially the same effect as when 
the direction and the zoom magnification of a single 
camera are instantaneously changed. 

Remote control is made possible by transmitting an 
image extracted from the extraction area 342 of the 
frame memory 320 to a terminal in a distant place via 
the network and transmitting the individual commands 
described above from the terminal in the distant place. 
The remote control is basically the same as when pan- 
ning, tilting, and zooming of a camera are remotely 
operated. 

In this embodiment, an image extracted from the 
extraction area 342 of the frame memory 320 is dis- 
played in the image display window 330 of the bit map 
display 35 and output to the network where necessary. 
However, it is obvious that the image can also be written 
into a file. That is, any output form is usable as long as 
the processing speed is sufficiently high. The image 
also can be compressed by the JPEG or MPEG coding 
scheme before being transfened. 

It is also evident that if the video camera 10 
includes a memory means which can be externally con- 
trolled, this memory means can be used instead of the 
frame memory 320. 

Although one extraction area 342 is set for an input 
image in the above embodiment a plurality of extraction 
ranges also can be set If this is the case, each extrac- 
tion range is provided with a camera window having an 
image display window for displaying an image extracted 
from the extraction range and an operation panel for 
setting the extraction area. Fig. 34 shows an example of 
a screen having four camera windows 350, 352, 354, 
and 356. Fig. 35 shows an exanple of setting of corre- 
sponding extraction areas 358. 360, 362, and 364 in the 
frame memory 320. Images extracted from the extrac- 
tion areas 358. 360. 362, and 364 are displayed in 
image cSsplay windows 350a. 352a. 354a. and 356a in 
the camera windows 350. 352. 354, and 356. respec- 
tively. Operation panels 350b, 352b. 354b, and 356b in 
the camera windows 350, 352, 354, and 356 are used to 
operate the positions and sizes of the extraction ranges 
358, 360, 362, and 364, respectively. 



The correspondence between the camera windows 
350, 352, 354, and 356 and the extraction areas 358, 
360. 362. and 364 is managed by a table as illustrated 
in Fig. 36. Virtual camera numbers directly correspond 

5 to the extraction areas 358. 360, 362. and 364. In 
accordance with an operation on the operation panels 
350b, 352b, 354b, and 356b, the corresponding values 
of e, <{>, and zoom magnification in the row of the corre- 
sponding operation panel ID are updated, and the cor- 

io responding extraction area is reset in accordance with 
these new values. 

Fig. 37 is a flow chart of an operation of capable of 
setting a plurality of extraction areas. This flow chart is 
formed by extending the flow chart shown in Fig. 33 so 
is as to correspond to each entry in the table in Fig. 36. 
The flow chart in Fig. 37 differs from the flow chart in 
Fig. 33 only in that loop processing is added. Assuming 
the frame rate of a dynamic image is F (frame/sec), N 
images can be extracted from an input image from a 

20 single camera so long as a procedure from step S31 1 to 
step S319 is executed within 1/F second. To transfer the 
images to the network, virtual camera numbers are 
added to the image data to be transmitted in order to be 
able to identify which image is extracted from which 

25 extraction area. A plurality of images with different vir- 
tual camera numbers can be displayed as if images 
from a plurality of cameras are displayed. 

In this way it is possible by physically using a single 
camera to obtain images in various directions at various 

so zoom magnifications, as if a plurality of cameras were 
used. It is of course possible to independently and 
instantaneously change the directions and zoom magni- 
fications of the individual images. 

By the use of a graphical user interface shown in 

35 Fig. 38. one or more extraction areas can be set more 
visually. Reference numeral 370 denotes an operation 
window for setting extraction areas. The size of this 
operation window is proportional to the size of an image 
obtained by excluding an imaging inhibited area from an 

40 input image to the frame memory 320. In the window 
370, rectangular frames 372, 374, 376, and 378 indicat- 
ing extraction areas with desired positions and sizes are 
set. These rectangular frames 372 to 378 are expanda- 
ble and movable within the area of the window 370. The 

4$ position and size of each rectangular frame in the win- 
dow 370 represent the position and size of the corre- 
sponding extraction area. When the rectangular frames 
372 to 378 are initially set, the points at opposing cor- 
ners of each rectangular frame are designated by using, 

so e.g., a mouse. As shown in Fig. 38, a portion of an input 
image to which each extraction area corresponds to can 
be clearly seen. 

As can be readily understood from the above 
description, in this embodiment the same effect as one 

55 obtainable when a plurality of cameras are used can be 
obtained by physically using a single camera. That is, it 
is possible to instantaneously change the direction and 
the zoom magnification of the virtual camera and to 
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simultaneously obtain images in various directions at 
various zoom magnifications. 

This embodiment can be combined with any of the 
second to fourth embodiments. 

In a case where the second embodiment is applied, 
if a designated extraction frame overlaps an imaging 
inhibited area, this designation is neglected and an error 
message is displayed. 

In a case where the third or fourth embodiment is 
applied, if a designated extraction frame overlaps an 
imaging inhibited area, the entire extraction frame is 
moved by an amount corresponding to the overlapped 
portion. More specifically, the extraction frame is moved 
toward the inside of an input image by amounts corre- 
sponding to the overlapped lengths in both the X-and Y- 
axis directions. 

The systems of the first to fifth embodiments 
described above can also be realized by connecting a 
camera to a general-purpose apparatus such as a per- 
sonal computer and supplying programs for performing 
the control in these embodiments from a storage 
medium. 

In this case, the program codes read from the stor- 
age medium realize the functions according to the 
embodiments, and the storage medium storing the pro- 
gram codes constitutes the invention. 

Further, the storage medium, such as a floppy disk, 
a hard disk, an optical disk, a magneto-optical disk, CD- 
ROM, CD-R, a magnetic tape, a non-volatile tape mem- 
ory, and ROM can be used for providing the program 
codes. 

Furthermore, besides aforesaid functions accord- 
ing to the above embodiments are realized by executing 
the program codes which are read by a computer, the 
present invention includes a case where an OS (Oper- 
ating System) or the like working on the computer per- 
forms a part or entire processes in accordance with 
designations of the program codes and realizes func- 
tions according to the above embodiments. 

Furthermore, the present invention also includes a 
case where, after the program codes read from the stor- 
age medium are written in a function expansion card 
which is inserted into the computer or in a memory pro- 
vided in a function expansion unit which is connected to 
the computer, CPU, or the like contained in the function 
expansion card or unit performs a part or entire process 
in accordance with designations of the program codes 
and realizes functions of the above embodiments. 

In a case where the present invention is applied to 
the aforesaid storage medium, the storage medium 
stores program codes corresponding to the flowcharts 
described in the embodiments. 

Claims 

1 . An image input system comprising: 

image pick-up means for picking-up an 
image in a predetermined area; 

setting means for setting an imaging inhib- 



ited area in which imaging is inhibited in the prede- 
termined area; 

input means for inputting an image of a 
desired area excluding the imaging inhibited area 
5 set by said setting means from the predetermined 
area picked -up by said pick-up means; and 

display means for displaying the input image 
from said input means. 

w 2. The system according to claim 1 , wherein 

said image pick-up means has at least one 
camera and camera moving means for moving a 
direction of the camera, 

said input means has control means for con- 
75 trolling said camera moving, and 

said control means controls said camera 
moving means so that said camera does not point 
to the imaging inhibited area. 

so 3. The system according to daim 2, wherein when 
said camera is already pointing to the imaging 
inhibited area set by said setting means, said con- 
trol means controls said camera moving means so 
that said camera points outside of the imaging 

25 inhibited area. 

4. The system according to claim 2, further compris- 
ing designating means for designating a direction of 
said camera, 

30 wherein when the direction designated by 

said designating means is within the imaging inhib- 
ited area set by said setting means, an error state is 
indicated. 

35 5. The system according to claim 2, further compris- 
ing designating means for designating a direction of 
said camera, 

wherein when the direction designated by 
said designating means is within the imaging inhib- 

40 rted area set by said setting means, said control 
means moves the direction of the said camera by 
controlling said camera moving means with correct- 
ing the designated direction so that the camera 
does not pick-up the imaging inhibited area. 

45 

6. The system according to claim 5, wherein the cor- 
rection of the designated direction of said camera 
by said control means is performed by moving the 
direction of said camera on a line connecting a 
so center of an area which said camera is allowed to 
point by said camera moving means and a point 
indicating the direction designated by said desig- 
nating means. 

55 7. The system according to claim 5, wherein the cor- 
rection of the direction of said camera by said con- 
trol means is performed such that said camera 
does not pick-up the imaging inhibited area and a 
correction amount is minimized. 
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8. The system accorcfing to claim 2, wherein when 
said setting means sets an imaging inhibited area, 
said camera is inhibited from changing its direction. 

9. The system according to claim 1 , wherein 

said image pick-up means has at least one 
fixed camera, and 

said input means has extracting means for 
extracting a desired partial region from an area 
picked-up by said camera, controls the partial 
region extracted by said extracting means so that 
the partial region does not overlap the imaging 
inhibited area, and inputs the partial region as an 
input image. 

10. The system according to claim 9, wherein said 
extracting means extracts a plurality of regions. 

11. The system according to claim 9. wherein said 
extracting means extracts the partial region desig- 
nated by a central position of the partial region and 
a display magnification. 

1 2. The system according to claim 1 , further comprises 
map display means for displaying a map showing 
an arrangement of said camera, wherein said 
image pick-up means includes at least one camera, 
and 

said setting means sets an imaging inhibited 
area on the map. 

13. The system according to claim 12, wherein said 
setting means partitions the map displayed by said 
map display means into a mesh and sets an imag- 
ing inhibited area in units of frames of the mesh. 

14. The system according to claim 12, wherein said 
setting means previously sets desired areas as 
candidates of an imaging inhibited area on the map 
displayed by said map display means and sets a 
desired area of the candidates as an imaging inhib- 
ited area. 

15. The system according to claim 1 . further comprises 
sensing enable area display means for displaying a 
sensing enable area at which said camera can pick- 
up an image, wherein said image pick-up means 
includes at least one camera, and 

said setting means sets an imaging inhibited 
area on the sensing enable area displayed by said 
sensing enable area display means. 

16. The system according to claim 1 , wherein 

said image pick-up means includes at least 
one camera, and 

said setting means sets a sensing inhibited 
area for at least one predetermined camera of said 
at least one camera. 



17. The system according to claim 16, wherein a cam- 
era for which an imaging inhibited area is set by 
said setting means is predetermined for each imag- 
ing inhibited area. 

5 

18. The system according to daim 16, wherein a cam- 
era for which an imaging inhibited area is set by 
said setting means is predetermined independently 
of an imaging inhibited area. 

w 

19. The system according to daim 1, further compris- 
ing connecting means for connecting said systems. 

20. The system according to daim 19. wherein said 
15 setting means sets an imaging inhibited area for 

image pick-up means of a local system without 
using said connecting means. 

21. The system according to daim 19, wherein said 
20 setting means sets an imaging inhibited area for 

image pick-up means of a system connected by 
said connecting means. 

22. The system according to daim 19. wherein said 
25 input means inputs an image picked-up by image 

pick-up means of a system connected by said con- 
necting means. 

23. The system according to daim 19, wherein said 
30 setting means sols an imaging inhibited area for a 

camera connected by said connecting means. 

24. An image input system for displaying an input 
image, comprising: 

35 at least one camera for picking-up an image 

of an object; 

camera moving means for moving said cam- 
era by one or both of panning and tilting; 

map display means for displaying a map 
40 showing a position of said camera and a direction in 
which said camera can be aimed by said camera 
moving means; 

setting means for setting an imaging inhib- 
ited area in which image-picking-up is inhibited on 
45 the map displayed by said map display means; and 
display means for displaying an image 
picked-up by a desired at least one of said at least 
one camera, 

so 25. An image input system for displaying an input 
image, comprising: 

at least one camera for picking-up an image 
of an object; 

camera moving means for moving said canv 
55 era within a predetermined range by one or both of 
panning and tilting; 

direction designating means for designating 
a direction of a desired camera of said at least one 
camera; 
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message display means for displaying a 
message indicating that said camera cannot be 
moved, when the direction designated by said 
direction designating means falls outside the prede- 
termined range; and 5 

image display means for displaying an 
image picked-up by said desired camera. 

26. An image input system for displaying an input 
image, comprising: 10 

at least one camera for picking-up an image 
of an object; 

camera moving means for moving said cam- 
era within a predetermined range by one or both of 
panning and tilting; is 

direction designating means for designating 
a direction of a desired camera of said at least one 
camera; 

control means for aiming said camera at a 
position closest to the direction designated by said so 
direction designating means, when the direction 
designated by said direction designating means 
falls outside the predetermined range; and 

image display means for displaying an 
image picked-up by said desired camera. 25 

27. The system according to claim 26, wherein when 
the direction designated by said direction designat- 
ing means falls outside the predetermined range, 
said control means moves said camera toward a 30 
point at which a line connecting a center of the pre- 
determined range and the direction designated by 
said direction designating means crosses a periph- 
eral edge of the predetermined range. 

35 

28. The system according to claim 26, wherein when 
the direction designated by said direction designat- 
ing means falls outside the predetermined range, 
said control means moves said camera in a direc- 
tion closest to the direction designated by said 40 
direction designating means and contained in the 
predetermined range. 

29. The system according to claim 26, wherein 

said camera is a zoom camera having a var- as 
iabie width of a field of view, and 

said control means sets said camera to a 
wide-angle side when the direction designated by 
said direction designation means falls outside the 
predetermined range. so 

30. An image input system for displaying an input 
image, comprising: 

at least one camera for picking-up an image 
of an object; 55 

region designating means for designating a 
partial region having a desired size and a desired 
position from an input image picked up by a desired 
camera of said at least one camera; and 



display means for displaying the partial 
region designated by said region designating 
means. 

31. The system according to daim 30, wherein said 
region designating means designates a plurality of 
partial regions. 

32. The system according to claim 30, wherein said 
camera inputs a dynamic image. 

33. The system according to claim 30, wherein said 
camera inputs a still image. 

34. The system according to claim 30. wherein said 
region designating means designates a partial 
region by using a central position and a display 
magnification. 

35. An image display method of displaying an image 
picked-up by image pick-up means, comprising: 

a setting step of setting an imaging inhibited 
area in which imaging is inhibited in a predeter- 
mined area; 

an input step of inputting an image of a 
desired area excluding the imaging inhibited area 
set by the setting step from the predetermined area 
picked-up by said pick-up means; and 

a display step of displaying the input image 
from the input step. 

36. The method according to claim 35, wherein the 
input step has a control step of controlling said 
image pick-up means so that said image pick-up 
means does not pick-up an image of the imaging 
inhibited area. 

37. The method according to claim 36, wherein when 
said image pick-up means is already picking-up an 
image of the imaging inhibited area set by the set- 
ting step, the control step controls said image pick- 
up means so as to pick-up an image of outside the 
imaging inhibited area. 

38. The method according to claim 36, further compris- 
ing a designating step of designating a direction of 
picking-up of said image pick-up means, 

wherein when the direction designated by 
the designating step is within the imaging inhibited 
area set by the setting step, an error state is incfi- 
cated. 

39. The method according to claim 36. further compris- 
ing a designating step of designating a direction of 
picking-up of said image pick-up means, 

wherein then the direction designated by the 
designating step is within the imaging inhibited area 
set by the setting step, the control step controls said 
image pick-up means by correcting the direction of 
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picking-up of said image pick-up means so that the 
direction does not contain the imaging inhibited 
area. 

40. The method according to claim 39, wherein the cor- 
rection of the direction of said image pick-up means 
by the control step is performed by moving the 
direction of said image pick-up means on a line 
connecting a center of an area which said image 
pick-up means can pick-up and a point indicating 
the direction designated by the designating step. 

41 . The method according to claim 39, wherein the cor- 
rection of the direction of said image pick-up means 
by the control step is performed such that said pick- 
up means does not pick-up the imaging inhibited 
area and a correction amount is minimized. 

42. The method according to claim 36, wherein when 
the setting step sets an imaging inhibited area, said 
image pick-up means is inhibited from changing it 
picking-up direction. 

43. The method according to claim 36, wherein 

said image pick-up means is fixed, and 
the input step has the extracting step of 
extracting a desired partial region from an area 
picked-up by said image pick-up means, controls 
the partial region extracted by the extracting step so 
that the partial region does not overlap the imaging 
inhibited area, and inputs the partial region as an 
input image. 

44. The method according to daim 43, wherein the 
extracting step extracts a plurality of regions. 

45. The method according to claim 43. wherein the 
extracting step extracts the partial region desig- 
nated by a central position and a display magnifica- 
tion. 

46. The method according to claim 35, wherein 

said image pick-up means includes at least 
one camera, and 

the setting step includes a map display step 
of displaying a map showing an arrangement of 
said camera and sets an imaging inhibited area on 
the map. 

47. The method according to daim 46, wherein the set- 
ting step partitions the map displayed by the map 
display step into a mesh and sets an imaging inhib- 
ited area in units of frames of the mesh. 

48. The method according to claim 46, wherein the set- 
ting step previously sets desired areas as candi- 
dates of an imaging inhibited area on the map 
displayed by the map display step and sets a 



36 

desired area of the candidates as an imaging inhib- 
ited area. 

49. The method according to claim 35, wherein 

5 said image pick-up means includes at least 

one camera, and 

the setting step includes a sensing enable 

area display step of displaying a sensing enable 

area at which said camera can pick-up an image 
10 and sets an imaging inhibited area on the sensing 

enable area displayed by the sensing enable area 

display step. 

50. The method according to daim 36, wherein 

is said image pick-up means includes at least 

one camera, and 

the setting step sets an imaging inhibited 
area for at least one predetermined camera of said 
camera. 

20 

51. The method according to claim 50. wherein a cam- 
era for which an imaging inhibited area is set by the 
setting step is predetermined for each imaging 
inhibited area. 

25 

52. The method according to claim 50, wherein a cam- 
era for which an imaging inhibited area is set by the 
setting step is predetermined independently of an 
imaging inhibited area. 

30 

53. The method according to claim 35. wherein the set- 
ting step sets an imaging inhibited area for local 
image pick-up means without using the connecting 
step. 

35 

54. An image display method of displaying an image 
picked-up by at least one camera moved by one or 
both of panning and tilting by camera moving 
means, comprising: 

40 a map display step of displaying a map 

showing a position of said camera and a direction in 
which said camera can be aimed by said camera 
moving means; 

a setting step of setting an imaging inhibited 
45 area in which image picking-up is inhibited on the 
map displayed by the map display step; and 

a display step of cisplaying an image picked- 
up by a desired one of said at least one camera. 

so 55. An image display method of displaying an image 
picked-up by at least one camera moved within a 
predetermined range by one or both of panning and 
tilting by camera moving means, comprising: 

a direction designating step of designating a 

55 direction of a desired camera of said at least one 
camera; 

a message display step of displaying a mes- 
sage indicating that said camera cannot be moved, 
when the direction designated by the direction des- 
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ignating step falls outside the predetermined range; 
and 

an image display step of displaying an image 
picked-up by said desired camera. 

56. An image display method of displaying an image 
picked-up by at least one camera moved within a 
predetermined range by one or both of panning and 
tilting by camera moving means, comprising: 

a direction designating step of designating a 
direction of a desired camera of said at least one 
camera; 

a control step of aiming said camera at a 
position closest to the direction designated by the 
direction designating step, when the direction des- 
ignated by the direction designating step falls out- 
side the predetermined range; and 

an image display step of displaying an image 
taken by said desired camera. 

57. The method according to claim 56, wherein when 
the direction designated by the direction designat- 
ing step falls outside the predetermined range, the 
control step controls said camera toward a point at 
which a line connecting a center of the predeter- 
mined range and the direction designated by the 
direction designating step crosses a peripheral 
edge of the predetermined range. 

58. The method according to claim 56, wherein when 
the direction designated by the direction designat- 
ing step falls outside the predetermined range, the 
control step moves said camera in a direction clos- 
est to the direction designated by the direction des- 
ignating step and contained in the predetermined 
range. 

59. The method according to claim 56, wherein 

said camera is a zoom camera having a var- 
iable width of the field of view, and 

the control step sets said camera to a wide- 
angle side when the direction designated by the 
direction designation step falls outside the prede- 
termined range. 

60. An image display method of displaying an image 
picked-up by at least one camera, comprising: 

the region designating step of designating a 
partial region having a desired size and a desired 
position from an input image taken by a desired 
camera of said at least one camera; and 

the display step of displaying the partial 
region designated by the region designating step. 

61. The method according to daim 60. wherein the 
region designating step designates a plurality of 
partial regions. 



62. The method according to claim 60. wherein said 
camera inputs a dynamic image. 

63. The method according to claim 60. wherein said 
5 camera inputs a still image. 

64. The method according to claim 60. wherein the 
region designating step designates a partial region 
by using a central position and a display magnifica- 

w tion. 

65. The system according to claim 24, further compris- 
ing control means for controlling said camera mov- 
ing means so that said camera does not take an 

is image of the imaging inhibited area set by said set- 
ting means, 

66. The method according to claim 54, further compris- 
ing a controlling step of controlling said camera 

20 moving means so that said camera does not take 
an image of the imaging inhibited area set by said 
setting step. 

67. The system according to claim 2. further compris- 
es ing designating means for designating a direction of 

said camera, wherein the camera has a zooming 
function, and said control means controls the cam- 
era to narrow the field of view of the camera when 
the direction designated by said designating means 
30 directs to the imaging inhibited area. 

68. The method according to claim 36, further compris- 
ing designating step of designating a direction of 
said camera, wherein the camera has a zooming 

35 function, and the camera is controlled to narrow the 
field of view of the camera when the direction des- 
ignated at said designating step directs to the imag- 
ing inhibited area. 

40 69. A computer readable memory storing a program of 
displaying an image taken by image pick-up means, 
comprising: 

codes of a process of setting an imaging 
inhibited area in which imaging is inhibited in a pre- 

45 determined area; 

codes of a process of inputting an image of a 
desired area excluding the imaging inhtorted area 
set by the setting step from the predetermined area; 
and 

so codes of the display step of displaying the 

input image from the input step. 

70. A computer readable memory storing a program of 
displaying an image taken by at least one camera 
55 moved by one or both of panning and tilting by cam- 
era moving means, comprising: 

codes of a process of displaying a map 
showing a position of said camera and a direction in 
which said camera can be aimed by said camera 
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moving means; 

codes of a process of setting an imaging 
inhibited area in which imaging is inhibited on the 
map displayed by the map display step; and 

codes of a process of displaying an image 5 
taken by a desired one of said at least one camera. 

71 . A computer readable memory storing a program of 
displaying an image taken by at least one camera 
moved within a predetermined range by one or both 10 
of panning and tilting by camera moving means, 
comprising: 

codes of a process of designating a direction 
of a desired camera of said at least one camera; 

codes of a process of displaying a message 15 
indicating that said camera cannot be moved, when 
the direction designated by the direction designat- 
ing step falls outside the predetermined range; and 

codes of a process of displaying an image 
taken by said desired camera. so 

72. A computer readable memory storing a program of 
displaying an image taken by at least one camera 
moved within a predetermined range by one or both 

of panning and tilting by camera moving means, 25 
comprising: 

codes of a process of designating a direction 
of a desired camera of said at least one camera; 

codes of a process of aiming said camera at 
a position closest to the direction designated by the 30 
direction designating step, when the direction des- 
ignated by the direction designating step falls out- 
side the predetermined range; and 

codes of a process of displaying an image 
taken by said desired camera. 35 
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